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ABSTRACT 

This paper provides a meta-analysis of current trends in 
student achievement in science by socioeconomic status and gender within 
ethnic groups'. Data from a variety of sources, such as the National 
Assessment of Education Progress (NAEP) and the National Education 
Longitudinal Study (NELS) reports were used. In addition, trends in student 
achievement from NAEP and NELS were contrasted with trends from college- 
entrance exams, such as the Scholastic Aptitude Test (SAT) and the American 
College Tests (ACT) . Finally, the observed trends in achievement were further 
contrasted with those emerging from the College Boards Advanced Placement 
(AP) Exams scores in science. The results of this analysis indicate that 
there is cause-for cautious celebration. There has been some improvement in 
student achievement and participation in science. However, it is alarming 
that the observed pattern of achievement by SES and gender within ethnic 
groups is consistent and congruent over time and across national studies and 
reports regardless of age and grade level. That is, it was observed that U.S. 
Asian and Anglo-European students consistently outperformed underserved 
students. Most U.S. Latinos and First Nations students are consistently in 
the middle of the achievement scale, whereas Puerto Ricans, and U.S. African 
students continue to be at the bottom of the scale. A closer look at the 
quality of the achievement gaps (i.e., achievement and participation by 
gender within ethnic groups) and not just at the size of the gap (strict 
score comparisons) indicates that much more could be learned from this form 
of analysis. In other words, more useful information from achievement scores 
was revealed when achievement by gender within each ethnic group was used as 
.the unit of analysis instead of using the achievement scores of Asian and 
Anglo-European males as the unit of analysis. For example, I found that in 
the last five years, and in spite of their low numbers, the absolute number 
of U.S. African females who outperformed their male counterparts in AP 
science tests has been increasing substantially. Therefore, this study points 
to the importance of conducting a longitudinal study with underserved 
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students who have been successful in science in spite of the variety of 
institutional and social obstacles they continue to face. By better 
understanding the factors influencing success in science courses from the 
traditionally underserved students' points of view, educators will be able to 
develop more effective and responsive intervention programs. (Contains 34 
references . ) (Author) 
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Terms Used 



The labels we use to place individuals or groups of individuals are embedded in cultural and 
historical capital. For example, institutions use labels for convenience and simplicity— a way to 
distinguish “the Other” from the norm. However, commonly used "people labels" are colonial 
and emphasize superficial physical differences. For instance, even though colonial terms such as 
"Master" or "Patron" are unacceptable today, terms such "Black," "White," "Indian" and "race" 
endure. Furthermore, even a new term was invented when the colonial use of "Spanish," 

"mulato"’ or "mestizo" was not appropriate to classify Latinos/as. Hence, the term "Hispanic" 
(meaning "of Spain") was created by the U.S. government in the late 1970s. 

In this paper, I refer to individuals by bringing attention to their ethnic and cultural heritage 
instead of bringing attention to the color of their skin. Even though, the terms I use may not 
accurately represent the cultural diversity within the ethnic groups considered in this paper, I 
believe they are more inclusive. In any case, my goal is to celebrate the fact that we all have 
ethnic roots that cut across artificial boundaries. Therefore, I use the following terms throughout: 

Latino/Latina instead of Hispanic 
African instead o/Black or African American 
First Nations instead of Indian or Native American 
Anglo-European or Anglo instead o/White 
Asian 

ethnicity instead of race 

underserved or underrepresented instead of minority 

In addition, I do not refer to individuals bom in the United States of America as "Americans." 
Latinos used the term "Americano" (American) across the continent to celebrate a spirit of 
solidarity. This spirit has deep historical roots beginning with the wars of independence from 
colonial rule to the creation of the Organization of American States (OAS). A good example of 
what I mean by spirit of solidarity is the OAS. The origin of this organization predates the United 
Nations. The OAS is based on the ideals of Simon Bolivar — the Latino who led the liberation of 
five South American countries from the Spanish Monarchy. 

Hence, Canadians, Mexicans, Costa Ricans, and individuals from the U.S. are all "Americans." 
Since I cannot use the term “American” to refer to individuals bom in the United States, I use the 
term “U.S.” in front of the word describing the individual’s ethnic roots. For example, instead of 
"Black" or "African American," I use the words “U.S. African." 



iv 
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Abstract 



This paper provides a meta-analysis of current trends in student achievement in science by 
socioeconomic status and gender within ethnic groups. Data from a variety of sources, such as 
the National Assessment of Educational Progress (NAEP) and the National Education 
Longitudinal Study (NELS) reports were used. In addition, trends in student achievement from 
NAEP and NELS were contrasted with trends from college-entrance exams, such as the 
Scholastic Aptitude Test (SAT) and the American College Test (ACT). Finally, the observed 
trends in achievement were further contrasted with those emerging from the College Board's 
Advanced Placement (AP) Exams scores in science. The results of this analysis indicate that 
there is cause for cautious celebration. There has been some improvement in student 
achievement and participation in science. However, it is alarming that the observed pattern of 
achievement by SES and gender within ethnic groups is consistent and congruent over time and 
across national studies and reports regardless of age and grade level. That is, it was observed that 
U.S. Asian and Anglo-European students consistently outperformed underserved students. Most 
U.S. Latinos and First Nations students are consistently in the middle of the achievement scale, 
whereas Puerto Ricans and U.S. African students continue to be at the bottom of the scale. 

A closer look at the quality of the achievement gaps (i.e., achievement and participation by 
gender within ethnic groups) and not just at the size of the gap (strict score comparisons) 
indicates that much more could be learned from this form of analysis. In other words, more 
useful information from achievement scores was revealed when achievement by gender within 
each ethnic group was used as the unit of analysis instead of only using the achievement scores 
of Asian and Anglo-European males as the unit of analysis. For example, I found that in the last 
five years, and in spite of their low numbers, the absolute number of U.S. African females who 
outperformed their male counterparts in AP science tests has been increasing substantially. 
Therefore, this study points to the importance of conducting a longitudinal study with 
underserved students who have been successful in science in spite of the variety of institutional 
and social obstacles they continue to face. By better understanding the factors influencing 
success in science courses from the traditionally underserved students' points of view, educators 
will be able to develop more effective and responsive intervention programs. 




Introduction 



Equity is the outcome of fundamental laws and policies which, when enforced, 
should guarantee fair treatment and access to resources and programs for all 
students. (Joint policy of the Washington State Board of Education, Office of 
the Superintendent of Public Instruction, and Washington State Human Rights 
Commission, 1994) 

Does equity mean mediocrity? Those who attack affirmative action and other equity programs 
fear that traditionally disadvantaged groups in the sciences (any male from an ethnic group other 
than Anglo-European, women, the disabled, and the poor) are given unfair advantages through 
these social programs. Some fear that establishing equity in schools and the workplace equates 
with establishing mediocrity and diluting the curriculum so that "all" students could succeed. The 
over simplistic argument that everyone has a choice and that all that is needed to succeed is to 
work hard enough is echoed by Ward Connerly, a successful, U.S. African business executive 
and member of the University of California Board of Regents. Connerly spearheaded the 1995 
Regents’ resolution to outlaw hiring and admission practices based on ethnicity and gender 
(Barinaga, 1996). The University of California admits the top 12.5% of the state's high school 
graduates. However, only 4% of Latino/a and 5% of U.S. African students are in that group. 
(Meanwhile, 53% of the student population in California's K-12 schools is from traditionally 
underrepresented ethnic groups.) 

This increasing incidence of equity-phobia is also fueled by the low standing of U.S. students in 
international achievement reports, such as the 1991 International Assessment of Educational 
Progress (Suter, 1996), the Third International Mathematics and Science Study (TIMSS), and the 
Survey of Mathematics and Science Opportunities (SMSO; National Research Council, 1996.) 
Even though TIMSS and SMSO researchers warn not to look at these studies as mere "horse 
races," the media and other interest groups use data from these studies to call for educational 
reform to maintain a strong economy and a strong military. 

No doubt these are important concerns, but what creates a conundrum is the conflicting 
juxtapositions that permeate educational reform in the United States. In other words, while 
educational research points out equity as an instrumental process to substantially effect change in 
today's schools, we have politicians and some interest groups increasing their attacks on 
affirmative action and other social programs. While national reform efforts such as the National 
Science Foundation's Statewide Systemic Initiatives (Laguarda, 1994), Project 2061: Science for 
All Americans (American Association for the Advancement of Science, 1989), and the recently 
released National Science Education Standards (NRC, 1996b), all make equity one of the 
primary driving engines of their recommendations for reform, we are not quite certain how to 
assess equity and/or how to tell when an educational system (at the state, district, or local level) 
has achieved a state of functioning equity, that is, the process by which an institution's equity 
policies deliver in practice what it promises in paper. 

Therefore, in light of the increasing pressures for educational reform at all levels, such as the 
extensive science education reform efforts spearheaded by the National Science Foundation's 
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Statewide, Urban and Rural Systemic Initiatives 1 (Shields, Corcoran, & Zucker, 1994), there is a 
need for greater clarity on the present state of student achievement in science. Moreover, in 
regard to equity, there is a need to better understand how the achievement of traditionally 
underserved students has changed in the last few years. 

We are now in a good position to estimate how student achievement in the U.S. has changed 
since the release of the eye-opening report A Nation at Risk: The Imperative for Education 
Reform (1983), prepared by the National Commission on Excellence in Education. The 
Commission's report got a great deal of attention as it demonstrated to the general public and 
policymakers how the U.S. was falling behind on international assessments in science and 
mathematics. The Commission charged that one of the main reasons "the rising tide of 
mediocrity" was flooding U.S. schools was the small number of required courses in science and 
mathematics. The Commission also claimed that the poor performance of U.S. students on 
national tests could also be improved if all students spent more time learning science and 
mathematics. 

In 1992, Blank and Engler took stock of how far we have moved since the Nation at Risk report. 
Two of their questions were: (1) Are students receiving more instruction in science and 
mathematics now compared to 10 years ago? and (2) Has student achievement in science and 
mathematics improved? The answer to the first question is very positive, mainly due to the fact 
that most states implemented policies to increase the number of mathematics and science credits 
required for graduation. However, the student participation rates in advanced science and 
mathematics courses remain small. For example, the rates for science course taking between 
females and males are equivalent except for more advanced courses such as physics. Female 
students continue to lead the enrollment in advanced biology courses (55%); whereas, boys 
continue to dominate advanced physics courses (60%; Blank & Engler, 1992). Information on 
underserved students' advanced course taking is more difficult to obtain, since these data are 
usually not available in national reports. 

The second question, whether student achievement in science and mathematics improved in the 
last ten years, was tackled by Blank and Engler (1992) based primarily on data from the 1990 
National Assessment of Educational Progress (NAEP). In this report, I expand on Blank and 
Engler's findings by comparing student achievement across grade levels, ethnicities, and 
socioeconomic status from two major national studies in the U.S. That is, in addition to NAEP, I 
draw from another large-scale assessment project, the First and Second Follow-up of the 
National Education Longitudinal Study (NELS). I also expand on Blank and Engler's analysis by 
contrasting the trends in achievement observed in national studies with those observed in 
national college-entrance exam reports. I draw from the American College Testing (ACT) 
Program and the Scholastic Aptitude Test (SAT) Annual Reports as well as from the Advanced 
Placement (AP) Program. A five-year block from 1990 to 1995 is primarily used in this study for 
comparing the trends in achievement across college entrance and advanced placement exams. 



] The actual impact on student achievement as a result of these reform efforts is currently under 
study. 
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Since equity is a fundamental construct guiding reform efforts, my goal was to find out not only 
how well students are performing in science, but to figure out how their participation in science- 
related/college-entrance exams has changed by gender, SES, and ethnicity. Furthermore, this 
report provides a more detailed analysis of academic performance by gender within ethnic 
groups. That is, instead of providing aggregated scores for "all" females or for only three 
"generic" ethnic groups, I provide a breakdown of the students' performance for males and 
females for each ethnic group whenever data was available. 

In short, three broad questions guide this analysis: 

a. What are the trends in student achievement in science by SES and gender 

within ethnic groups? 

b. In what ways are the various national studies and reports on student 

achievement congruent with one another? 

c. What do the answers to the above questions tell us about the state of science 

education in the U.S. and what suggestions do they provide for further study in 

terms of equity? 



Reports and National Studies on Student Academic Achievement in Science 

Several key government agencies are mandated by law to monitor students’ educational 
progress, including the Office of Educational Research and Improvement in the Department of 
Education. Since 1969, this agency has sponsored the National Assessment of Educational 
Progress (NAEP). Every two years, NAEP evaluates the academic achievement of a nationally 
representative sample of elementary (Grade 4) and secondary (Grades 8 and 12) students. In 
spite of the limitations of NAEP, it is probably the most comprehensive tool for assessing 
students' cognitive achievement in science at critical grade levels (Mullis, Dossey, Campbell, 
Gentile, O'Sullivan, & Latham, 1994). 

The Office of Educational Research and Improvement sponsors another important educational 
attainment project, the National Education Longitudinal Study (NELS; Horn, Hafner, & Owings, 
1992; Owings & Peng, 1992; Rock & Pollack, 1995). The goal of this study was to measure 
cognitive growth in science over time. Furthermore, the NELS aimed to investigate the impact of 
school policies, family participation, and teacher practice on educational outcomes as the 
students developed and made challenging transitions from middle school, to high school, to 
college. 

Several other agencies and studies are worth mentioning in more detail, but due to space 
limitations I will only briefly discuss below the trends in student achievement identified in the 
NAEP and NELS projects. 

NAEP Trends 

The NAEP study is designed to draw from a representative sample of the student population in 
grades 4 (age 9), 8 (age 13), and 12 (age 17). For example, in 1990, approximately 45,000 



3 




11 



students per grade participated in the assessment. To facilitate interpretation of NAEP scores, 
students' performance is assessed according to a five-level proficiency scale (Mullis et al., 1994) 
as follows: 

350 Student can infer relationships and draw conclusions using detailed scientific knowledge. 
300 Student has some detailed scientific knowledge and can evaluate the appropriateness of 
scientific procedures. 

250 Student understands and applies general information from the life and physical sciences. 

200 Student understands some simple principles and has some knowledge, for example, about 

plants and animals. 

150 Student knows everyday science facts. 

Figure 1 illustrates that, compared to 1970 scores, the average science achievement for all 
students who participated in the 1992 NAEP (Mullis et al., 1994), was slightly higher for 9-year- 
olds, practically the same for 13-year-olds, and lower for 17-year-olds. (The standard errors for 
the estimated proficiencies are shown in Table 1.) Though it may not appear so, this bad news 
hides some good news. The overall science performance for all three age groups has actually 
been increasing since 1982. 

In the last twenty years, according to NAEP (Mullis et al., 1994), the gap in science performance 
scores of students of African, Latino/a, and Anglo-European descent 2 closed modestly from 1977 
to 1986. From 1986 to 1992, however, the achievement gains of underserved students seem to 
have stalled (see Figures 2 and 3). Furthermore, in spite of the improvement in the last ten years, 
the differences in performance among ethnic groups are still quite large for all three age groups 
considered. For example, in 1992 the gaps in proficiency scores among students from Anglo- 
European and African ethnic backgrounds were 48 points for 17-year-olds, 43 points for 13-year- 
olds, and 39 points for 9-year-olds (see Figure 2 and Table 2). In essence, these differences in 
scores mean that 17-year-old U.S. African students scored lower (256) than Anglo-European 13- 
year-olds (267). Similar differences were observed between U.S. Anglo-European and Latino/a 
students (i.e., 34, 30, and 34 points per age level respectively; see Figure 3 and Table 2). This 
means that 17-year-old Latinos/as scored only three points (270) above Anglo-European 13- 
year -olds (267). Nevertheless, as Figure 3 illustrates, the gap in achievement between Anglo and 
Latino/a students continued to shrink at ages 13 and 17. 

The gaps in proficiency scores are less wide between U.S. Latinos/as and African students. 
However, the difference in performance between these two ethnic groups seems to be increasing 
in favor of 13- and 17-year-old Latinos/as (Figure 4). 

The genderdifference in the average proficiency scores between 13- and 17-year-old males and 
females seems to be decreasing (Figure 5). The differences in 1992 scores were 10 points for 17- 
year-olds, 4 points for 13-year-olds, and 8 points for 9-year-olds. Interestingly, while both males 
and females made some gains in the last decade, males have had higher scores at all three age 



2 

The National Assessment of Educational Progress study only reports on the academic 
achievement of these three ethnic groups. 



levels since 1970. This pattern should be interpreted with caution, since none of the differences 
in scores by gender and by age has been statistically significant since 1969-70. 

Caution should also be followed when interpreting NAEP scores for Latino/a students. NAEP 
results are less reliable for Latinos/as due to the confusion some individuals face when trying to 
identify Latino/a children (Grissmer, 1996). That is, Latinos/as could be of any shade of skin 
color and/or could have any range of proficiency in English; therefore, it is difficult for local 
officials administering the NAEP tests to box Latinos/as into preset ethnic categories. In fact, it 
was not until 1977 (seven years after the first NAEP study) that the category of "Hispanics" was 
created to include all Latino/a students. 

NELS Trends 

In its base year, 1988, the National Education Longitudinal Study (NELS) involved 25,000 
eighth graders from over 1000 randomly selected schools across the U.S. In addition, NELS 
gathered information from students, their parents, teachers, and school administrators. Three 
follow-up studies of the 1988 eighth-grade cohort have been conducted so far (in 1990, 1992, 
and 1994), and a fourth follow-up study is planned for 1998. 

Findings from the NELS' base year and first follow-up support the same trends in achievement as 
those described in the NAEP reports. In other words, all ethnic groups showed improvement in 
their science performance scores in the first follow-up (Table 3; Scott, Rock, Pollack, & Quinn, 
1995); however, the gap in achievement was maintained between Anglo- European and Asian 
students and African and Latino/a students. Moreover, the U.S. Anglo and Asian students 
showed the most gain in average scores (by half to three quarters of a standard deviation) in 
comparison to U.S. African and Latino/a students. 

A similar pattern to NAEP scores was also observed for the NELS gender gap between grade 10 
males and females (Table 3). In addition, males not only outperformed females in both the base 
year and first follow-up tests (by one-fifth of a standard deviation), but they also showed the 
larger gains in scores (Scott et al., 1995). Table 3 also illustrates the pattern of achievement 
according to the students' socioeconomic status. Students from the top SES quartile obtained 
higher scores and showed the most gains over time. 

The NELS' second follow-up with grade 12 students was more detailed and allowed for a more 
in-depth analysis of academic growth (Green, Dugoni, Ingels, Cambum, & Quinn, 1995). 
Students were given four cognitive tests in reading, science, mathematics, and 
history/govemment. The scores were interpreted according to the following four-level 
proficiency scale: 

Below Basic: 

Basic: 

Intermediate: 



Does not demonstrate understanding of everyday science concepts. 
Understanding of everyday science concepts; "common knowledge" that 
can be acquired in everyday life. 

Understanding of fundamental science concepts upon which more com 
plex science knowledge can be built. 
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Advanced: Understanding of relatively complex scientific concepts; typically requir 

ing an additional problem solving step. 

Figure 6 illustrates that slightly over 28% of U.S. Asian students scored at the Advanced level of 
science proficiencies, followed closely by 26.3 % of the Anglo-European students. But only 1 1% 
of Latinos/as and 5.4% of African students attained the Advanced proficiency level. This pattern 
reverses dramatically at the Below Basic level with 34.5% of African and 25.8% Latino/a 
students scoring at this mark. Note that the achievement gap is narrower among all underserved 
students at the Intermediate level, (Table 4 includes the statistical data for the information shown 
in Figures 6 to 8.) 

In relation to gender differences, unfortunately just as with NAEP, NELS does not provide data 
on the performance score distribution by gender within ethnic groups. However, the differences 
in achievement between males and females are shown in Figure 7. Males dominate the Advanced 
proficiency level by almost 8 percentage points, whereas, females are slightly ahead at the 
Intermediate level by almost 2.5 percentage points. By combining the percentage of students 
who scored at the Basic and Below Basic levels, we see that 49% of the female high school 
seniors do not understand fundamental principles of science, whereas 44% of the males are in the 
same predicament (see Table 4 and Figure 7). 

This trend in achievement is also shown in the score distribution according to socioeconomic 
status. That is, almost 68% of students from low income families and 47% of students from 
medium-income families do not appear to understand the fundamental principles of science (see 
Figure 8 and Table 4). On the other hand, 75% of high-income students scored at the 
intermediate and advanced proficiency levels. 

Findings from NELS follow-up studies no doubt produce a great deal of valuable information on 
the experiences of middle schoolers as they progress through school and through college. 
However, the same problems related to identifying Latino/a students mentioned above for NAEP 
also occur to NELS. In addition, one of the drawbacks of longitudinal studies such as NELS is 
that it provides a less reliable assessment of students' cognitive performance due to the short 
length of time allocated for the science test (Rock & Pollack, 1995). That is, NELS allows only 
20 minutes for students to answer the 25 multiple-choice question section; the NAEP science 
component has 63 multiple-choice questions at age 9, 83 multiple-choice questions at age 13, 
and 82 multiple-choice questions at age 17 (Mullis et al., 1994). 

In sum, the pattern in academic performance by gender, socioeconomic status, and ethnicity 
observed so far in NELS is congruent with that observed in NAEP, even though there are marked 
differences between the two studies. One significant drawback in interpreting the results of these 
national studies is that they do not provide a breakdown of the achievement scores by gender 
within ethnic groups. Therefore, it is not possible to determine, for example, whether the 
achievement level of U.S. African girls is different from that of U.S. African boys, or different 
from that of females from other ethnic groups. Similarly, it is not possible to determine whether 
Mexican boys are achieving at a higher rate than Puerto Ricans or than students from other 
Latino groups. It is essential that more detailed information be gathered and made readily 
available in order to effectively assess student achievement in terms of equity. This information 



6 




14 



is especially imperative when we consider how rapidly the U.S. population is changing. For 
instance, according to the 1990 U.S. census, Mexicans constitute the largest ethnic group of the 
Latino/a population (about 63%), Other Latinos (peoples from various Latin American countries) 
represent the second largest group (at 14%), and Puerto Ricans constitute the third largest group 
(at 11%). Also projections in population growth (Day, 1993) estimate that Latinos will constitute 
the second largest ethnic group in the U.S. by the year 2010. 

Given the trends in student achievement observed in NAEP and NELS, and given the limitations 
of these studies, how do these trends compare with the trends in achievement observed in the two 
commonly used college entrance exams in the U.S.: the American College Test (ACT) and the 
Scholastic Aptitude Test (SAT)? How do these trends compare with trends in achievement in 
advanced placement (AP) exams? Do college entrance exam annual reports provide more 
detailed information on student achievement by gender within ethnic groups? These questions 
are the focus of the next sections. 

ACT Trends 

The American College Test (ACT) is widely used by many universities and colleges as a 
predictor of postsecondary education success. 3 Students are evaluated on the basis of their 
performance in four subject areas: English, Mathematics, Reading Comprehension, and Science 
Reasoning. 4 The ACT Program also reports the students’ composite scores, as well as compiling 
some information on the students’ career goals and academic, socioeconomic, and ethnic 
backgrounds. 

The ACT annual reports include information on the performance of students who followed a core 
sequence of high school courses and those who did not. The core sequence consists of four years 
of English, three or more years of mathematics, three or more years of social sciences, and three 
or more years of natural sciences. For the purpose of this analysis, the average score for both 
core-sequence and less-than-core-sequence students combined is used. Furthermore, since the 
focus of this study is on trends in student achievement in science, only the students’ scores on the 
ACTs Science Reasoning (SR) component from 1992 to 1995 by gender within ethnic groups 
will be discussed. The ACT does not provide a breakdown of the students' average scores by 
SES. Also, since a new Science Reasoning Test was introduced in 1991, comparisons of the 
students' performance from previous years is not possible. 

The SR component was designed to assess the candidates' interpretation, evaluation, reasoning, 
and problem-solving skills in the natural sciences. As Figure 9 shows, trends in the Science 
Reasoning scores reveal a very similar pattern to that discussed above for the national studies. 
Figure 9 also contrasts the overall national mean scores with the national mean scores for males 
and females within ethnic groups. (Table 5 shows the national male and female mean scores plus 



3 ACT officials point out that test results should not be interpreted as representative of the 
college-bound student population, because ACT test-takers are usually overrepresented in some 
areas of the country. For instance, a larger percentage of ACT takers come from the Midwest, 
Rocky Mountains and Plains, and the Southern areas of the USA. 

4 The score scale for all tests is from 0 to 36 points. 
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